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Abstract 



We consider irreducible Markov chains on a finite state space. We show that the mixing time 
of any such chain is equivalent to the maximum, over initial states x and moving large sets (A s ) s , 
of the hitting time of (A s ) s starting from x. We prove that in the case of the d-dimensional 
torus the maximum hitting time of moving targets is equal to the maximum hitting time of 
stationary targets. Nevertheless, we construct a transitive graph where these two quantities are 
not equal, resolving an open question of Aldous and Fill on a "cat and mouse" game. 
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1 Introduction 

Mixing times and hitting times are fundamental notions for finite-state Markov chains. Both have 
been widely studied (see, e.g., [1] or [5] for background and numerous references) and a great variety 
of techniques have been developed to analyze them. 

We begin by fixing some notation and reviewing previous work relating these two quantities. 

Let (Xt)t>o be an irreducible Markov chain on a finite state space with transition matrix P and 
stationary distribution ir. For x, y in the state space we write 



for the transition probability in t steps. 

Let d(t) = max [|P*(sc, •) — vr 1 1 , where \\fi — u\\ stands for the total variation distance between the 

X 

two probability measures fi and v. The total variation mixing is defined as follows: 



We use the convention that i m ; x = t m ; x (l/4). 

Before stating our first theorem, we introduce the maximum hitting time of "big" sets. Let a < 1/2, 
then we define 



P t (x,y)=F x (X t = y), 




min{t > : d(t) < e}. 



tn(a) 



max E x [t a ] 

x,A:ir(A)>a 
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where ta stands for the first hitting time of the set A. 

We say that two real- valued functions / and g are equivalent, denoted / X g, if there are universal 
positive constants c and d such that cf < g < c'f. If the constants are allowed to depend on a 
parameter a, we write / x a g. 

Aldous (1981) related mixing and hitting times by proving that t cts x max^ 7r(^4)E x [r J 4] for all 
reversible chains, where t cts is the mixing time of the continuous time chain. In two independent 
recent papers by Imbuzeiro Oliveira [I] and Peres and Sousi [8] it was proved that for all reversible 
chains, if a < 1/2, then 

th x a tn(a), (1.1) 

where £l is the mixing time of the lazy version of the chain, i.e. the chain with transition matrix 
p+i 

2 ■ 

Very recently, Griffiths, Kang, Imbuzeiro Oliveira and Patel |3j showed that tn(a) < tn(l/2)/a for 



all a < 1/2. Hence this together with (1.1) or with Aldous' result implies that for all reversible 
chains if a < 1/2, then 

th —a £h(o0, 

with the equivalence failing if a > 1/2. 



For non- reversible chains equation (1.1) may fail, e.g. for biased random walk on the cycle Z n we 
have £l >^ n 2 , while tn(a) x n, for any a > 0. During a lecture on [8J by Yuval Peres, Guy Kindler 
proposed that for non- reversible chains the right analogue of ( |1.1[ ) involves moving targets. Our 
first result establishes this equivalence. 

Let a G (0, 1) and A(a) denote the collection of sequences of sets defined as follows: 

A(a) = {A = (A t ) t >o ■ Vt > 0, 7r{A t ) > a}. 
For A G A{a) define t a = inf{t > : X t € A t ] and 

imov(a) = sup E x [rA]. 

Theorem 1.1. For a < 1/2, t m j x x t m ov(«)- 
We will prove Theorem |1.1| in Section [2] 

Remark 1.2. We note that Theorem |1 . 1 1 does not require the chain to be either lazy or reversible, 



as is the case for (1.1). In this setting the equivalence holds for any chain. 

Theorem 1 1 . 1 1 and (1.1) immediately give that for all reversible lazy chains and for any a < 1/2 

*mov(«) tn(a). 

If the chain is not reversible, though, the above equivalence can fail. For instance, for the biased 
random walk on Zyx, if A — (yl^)^ are sets moving at the same speed as the random walk, then 
^[ t a] x n 2 agreeing with the mixing time t^. 

We next consider the problem of colliding with a moving target on a graph. In the following theorem 
we show that in the case of toroidal grids, the best strategy for the target, to avoid collision as long 
as possible, is to stay in place at the maximum distance from the starting point. As a corollary, we 
show that in the 1-dimensional case the two quantities in and t mov are equal. 
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Theorem 1.3. Let X be a lazy simple random walk on Z^ and f : N — > Z^ a function. Then 
setting a = ([n/2\ , . . . , \ n/2\ ) we have for all t 

F {X 1 + /(l), ...,X t ^ f(t)) < F (X 1 ^a,...,X t ^a). 

Remark 1.4. Note that if the random walk X on Z^ is not lazy, then one can always choose a 
function / : N -)■ so that 

F (X 1 ^f(l),...,X t ^f(t)) = l, 
and hence the conclusion of Theorem 1 1 . 31 fails . 



Corollary 1.5. Let X be a lazy simple random walk on Z„ = {0, 1, . . . , n — 1}. Then for all n, a 
we have 

tn{a) = t mov (a). 

We prove Theorem |1.3| and Corollary |1.5| in Section [3] using a discrete version of rearrangement 
inequalities. We employ a polarization technique which has been used extensively in the continuous 
setting to prove several classical rearrangement inequalities (see, for instance, [2]). As a by-product 
of the discrete rearrangement inequality, we also prove that the expected volume of the "sausage" 
around a discrete lazy simple random walk on Z d with drift is minimized when the drift is equal 
to 0. 

Proposition 1.6. Let X be a lazy simple random walk on Z d and let f : N — > Z rf be a function. 
Then for all t £ N and all n G N 



E 



vol \J(X s + f(s) + Q n ) 



\s=0 



> E 



vol \J(X S + Q n ) 



\s=0 



where Q n 



-n, n 



A more general isoperimetric inequality for the expected volume of the Wiener sausage has been 
proved in [7j; the stronger Proposition 1.6 makes use of the symmetries of Z d and does not hold in 
general. 



Finally, in the last theorem, we show that that the equality of Proposition |1.5| is not always true 
for a reversible Markov chain. This resolves an open question of Aldous [1, Chapter 4, Open 
Problem 20] and of Imbuzeiro Oliveira [6] . 

We say that X is a continuous time random walk on a graph if it stays at every vertex for an 
exponential amount of time of mean 1, and then jumps to one of the neighbours uniformly at 
random. 

Theorem 1.7. There exists a transitive graph G = (V,E) such that if X is a continuous time or 
lazy random walk on G, then 

maxEj^] < sup E, x [r f ], 

x,f&V m + 



.i.y 



where T f = inf{t > : X t = f(t)}. 

In [1] and [6] this was stated as a cat and mouse problem and it was conjectured that the best 
strategy for the mouse to maximize the expected capture time is to stay in place. In our graph G 
we show that this is not the case. We prove Theorem 1.7 in Section |4j 
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2 Moving targets 



Proof of Theorem 11.11 We first show that i mov < cii m ; x , where c\ is a positive constant. 
Let t = t m ; x (a/2) < [~log 2 (l/a)]t m i x . Then for all x and all sets A we have 

P\x,A)>*{A)-*. 

Take a sequence of sets A = (A s ) £ A(a). Then for all s and all starting points x we have 

P\x,A s )>*. (2.1) 



If r = min{A; > : Xj~t 6 A^t}, then obviously we have ta < tr. By (2.1), it follows that r is 
stochastically dominated by a geometric random variable of success probability a/2. Therefore, 

2t 

E x [r A ] < tE x [r] < -, 
a 

and hence this gives that 

2pog 2 (l/a)l 4 

t-mov _ t-mix 

a 

and this completes the proof of the upper bound. 

We now show the other direction, i.e. that there exists a positive constant C2 so that 

Since a < 1/2, there exists e > such that a + e < 1/2. By 4.35], it follows that there exists 
a positive constant C3 such that i m ix(a + e) > C3t m i x . Let i < t m ix(a + e)- Then this means that 
there exists x and a set A so that 

P\x,A) <ir(A)-(a + s). (2.2) 

From that we immediately get that tt(A) > a + e. We now use the set A to define a sequence of 
sets (B s ) as follows: for s < t define 

B s = {y:P t - s (y,A)>ir(A)-a} 

and for s > t we let -B s = Q. Since ir is stationary, it follows that 

Rearranging, gives that tt(B s ) > a for all s. We write tb = min{t > : Xt G i?t}. We will show 
for a constant to be determined later we have that 

E x [T B ]>9t. (2.3) 

We will show that for a 9 to be specified later, assuming 

maxE z [r B ] < 9t (2.4) 

will yield a contradiction. 



By Markov's inequality and (2.4) we have that for all z 

w z (T B <t) >i-e. 

By the strong Markov property applied to the stopping time tb and Markov's inequality we have 
P*(*t 6i)> PspTt €A\t b < t)F x (T B <t)> inf inf F w (X t ^ s E A) (1 — 9) > (n(A) - a) (1 - 9) , 

s<t uiG-Bs 

which by choosing 9 small enough can be made bigger than it (A) — (a + e). This contradicts the 
choice of x in (2.2). Therefore (2.3) holds and this completes the proof. □ 



4 



3 Collision with a moving target on 1 d n and Z c 



In this section we prove Theorem 1.3 and Proposition 1.6 We start by introducing some notation 
and background on rearrangement inequalities. We follow closely Section 2.1 of Burchard and 
Schmuckenschlager [2]. 



3.1 Notation and background 

Let M be a metric space. A reflection a : M — > M is an isometry such that 

• a 2 x = x for all x G M; 

• M is the disjoint union of the set of fixed points H°, and two half spaces H~ and H + which 
are exchanged by a, i.e. 

ax = x x G H°, 
aH + = H~; 

• d(x,y) < d(x,ay) for all x,y £ H + . 

From now on whenever we define a reflection a we will specify H + and H~ . 
The two-point rearrangement of a function / is defined to be 

{max{/(», /(era;)}, if x G H+; 
mm{f(x),f(ax)}, if x G H~; 
f(x), ifxeH . 

By taking / = 1(A) we get that the two-point rearrangement of a set A, denoted A a , satisfies 

A a n H + = (A U a A) n + 

^4 CT n h = (ind)nr. 

We now recall a combinatorial lemma from [21 Lemma 2.6]. 

Consider the two-point space {+, — } with the metric defined by d(+, — ) = 1. The map a that 
exchanges + and — is a reflection with no fixed points and with H + = {+} and H~ = {—} as 
the positive and negative half-spaces. For any function ip on {+, — }, let ip a be the corresponding 
two-point rearrangement of <p: 

ip a (+) =maxM+), ¥>(-)} and <p a (-) = min{ ¥ >(+), (p(-)}. (3.1) 

Lemma 3.1 (Burchard and Schmuckenschlager [2]). Let <pt,...,<p n be nonnegative functions on 
the set {+, — }. For each pair ij , let kij(e,e') = aij + 6yl(e = e') with aij,bij > 0. Consider the 
function 

J(<P!,...,tp n ) = ^ Y[ ipi(Si) Y[ h,j(ei,Ej). 
± l<i<n 

Then 

J(cpi,...,lf n ) < J(lf1,...,ip°). 
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3.2 Random walk on lA 



Lemma 3.2. Let a be a reflection in and X a lazy simple random walk in Z^. Then for all 
times t, all starting states b and all sets Di C Z^ we have 

P(Xi g A,. .. ,X t € A | X g {&}) < P(Xi 6D?,...,X f eD f ff |loe {6} CT ) . 

Proof. Let p(x, y) be the transition probability in one step of the lazy simple random walk in Z^, 
i.e. ^ 

pO,y) = = y)^ + ^-(k - y| = !)^- 

By the Markov property we have 

t t 

F(X 1 eD 1 ,...,X t eD t \X e{b})= ^ IJpfo-i.a*) Jlifo g A), 



xo,...,a; t i=l 



i=0 



where -Do = {^}- If an d ^ are the positive and negative respectively half spaces exchanged 
by a, then we can write the above sum 

t t t t 

x ,...,x t i=l i=0 x ,...,x t £H+ ± i=l i=0 



where 



x, if x G i?" 1 
ax, if x G H~ 



and x 



ax, if x G 
x, if x G H~ 



(3.2) 



We now fix a choice of xi, . . . , x% G H . It suffices to show that 

En^ti^ni^e Aj^En^-i'^ri 1 ^ 6 ^)- (3.3) 

± i=l i=0 ± i=l i=0 

For e, e' G {+, — } we define kij(e, s') = 1 if j — i 7^ 1 and otherwise 

1 ,j ; (e , e' ) = p(a£. 1 , x+ ) + 1 (e = e' ) (p(xf_ x , x+ ) - pix^ , xf) ) . 

By the definition of the transition probability we have p(x^_ l , xf ) < p(xf_ x , xf) for Xj_i, Xj G 
Therefore fcjj satisfies the assumptions of Lemma 3.1 and if we set (pi(s) = l(x? G A); then we 
can write 



t t t 

± i=l 1=0 ± i=0 0<i<j<t 



(3.4) 



Applying Lemma 3.1 we infer 



En^^) n *«j( e <« e j)^Eii^ n km^j)- 

± i=0 0<i<j<t ± i=0 0<i<j<t 



(3.5) 



Since ^f(e) = l(xf G A)' inequality (3.5) together with (3.4) concludes the proof of (3.3) and 
thus completes the proof of the lemma. □ 
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Figure 1: A reflection on 7L% 



Remark 3.3. Note that it is essential that the random walk on be lazy. In the proof above 



this was used to show that the kernel k satisfies the assumptions of Lemma 3.1 



Proof of Theorem 11.31 We first prove the theorem for d = 1. 
For % = 1, . . . , t we write D{ = Z n \ {f(i)}- Then we have 

F (X 1 £ /(l), ...,X t ? ffl) = P (Xi € D\, ...,X t E D t ) . 

We now want to find a sequence of reflections 0*1, . . . , crj. such that D° 1 — ah = Z n \ {a}. 

We first give the reflection a such that Df = Z n \ {a}. We carry out all the details in the case 
when n is odd and /(l) + a is even and satisfies /(l) + a > n — 1. The other cases follow similarly. 
We define 

= (a + /(l) — x) mod n 



and we let 

_ //a+f(l) 1 

U 



2 



a + /(l) _n-- aiul 



Then with this definition of and -ff it is clear that D^ 1 = Z n \ {a} and (Z n \ {a}) CT1 = Z n \ {a} 
and {0} ai = {0}. 

Having symmetrized the set Di, we now want to find a reflection 02 such that D^ 1 ^ 2 = Z n \{a}. To 
do that we use exactly the same construction as for o\ above. Hence we get (Z n \ {a}) U2 = Z n \{a} 
and {0}' 72 = {0}. Therefore D" 1 " 2 = Z n \ {a}. Continuing in this manner we find k < t reflections 
o"i , . . . , (Tfc such that for all i 

= Z n \ {a}. 
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Figure 2: A reflection on Z9 



Applying Lemma 3.2 k times when b = 0, i.e. for the reflections ax, ... , a^, concludes the proof in 
the case d = 1. 

For higher dimensions, the statement follows from carrying out the above procedure coordinate by 
coordinate. □ 



Remark 3.4. We note that for a continuous time random walk on the analogue of Theorem 1.3 
holds, i.e. 

¥ (X S + /( a ),Va <t)< F (X S ^ a, Vs < t) . 

To see this, view the continuous time walk as the continuous time version of the lazy walk with 
exponential clocks of rate 2. Then condition on the number of lazy steps taken by the continuous 



time walk by time t, and apply Theorem 1.3 



Proof of Proposition 1.5[ It is clear that on the cycle Z n among all sets A of the same measure 



the hardest to hit is an interval. The first hitting time of an interval on the cycle is the same as 
the first hitting time of the endpoints, which can be glued to a single point, and hence the hitting 
time is maximized when this point is staying fixed. □ 



3.3 Random walk on 7h d 



In this section we prove Proposition 1.6 The proof follows in a similar way to the proof of Propo- 



sition 1.5 and uses again Lemma 3.1 



Lemma 3.5. Let X be a lazy simple random walk on Z rf starting from and let (Di) be subsets of 
Z d that are symmetric around the origin, i.e. D{ = —Di for all i. If a is a reflection on 7L d , then 
for all t we have 



E 



vol (J (X s + D s 



> E 



vol (\J(X S + D° 



\s=0 
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Proof. Since D s = 



—D s for all s, we have 



E 



vol (j(X s + Ds 



\s=0 



E 



E 



]T i lx e\J(X s + D s )\ 

x ez d V s=o / _ 

^2 1 (3s < t : X s £ x + D 



Let p(x, y) be the transition probability in one step of the lazy simple random walk in Z d , i.e. 

p{x,y) = l(x = y)- + l(|x -y\ = 1)-^. 
Then the Markov property of the random walk gives 

t t 

F(3s<t: X s ex + D s ) = l- fJpCz/i-i, Vi) l(yi £x + A), (3.6) 

yi,...,y t i=l i=0 

where yo = 0. Changing variables to yi — xq and noticing that p(0, y\ + x$) = p(—xo, y±) gives that 
the sum appearing in the right-hand side of (3.6) is equal to 

t t 
E p(-x ,yi)l(-x i D ) JJp(j/i_i,2/i) JJl(y» $ A)- 



yi,---,yt 



i=2 



t=l 



Putting everything together in the expression for the expected volume of U s <t(£(s) + -D s ) and 
changing variables from — xq to xq we get 



E 



vol UQ n (/( S ) + £00) 



E f[p(a*-i>**) I 1 " II 1 ^^^) 



(3.7) 



8=0 



Decomposing the above sum into the positive and negative half spaces of cr, the right hand side 
of (3.7) can be written as 



xo,xi,...,3:t 



e #+ ± i=i 



i=0 



where x + and x are as defined in (3.2) in the proof of Lemma 3.2. Repeating the same arguments 
as in the proof of (3.3) in Lemma 3.2 we get 



± i=i 

Hence, we conclude that 



i=o 



± i=i 



i=0 



E 



vol (J (ew+A 



vs=0 



> E 



vol U(C( S ) + ^) 



and this finishes the proof of the lemma. 



□ 
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Proof of Proposition 1.6[ Let r > 0, x G Z d and Q r {x) = [—r + x\,r + xi] x . . . x [— r+Xd, r+Xd) 
be the box in Z d of side length 2r + 1 centered at x. We want to show that 



E 



vol((J(£00 + Q»(/(s))) 



vs=0 



> E 



vol ((J + 3") 



vs=0 



where Q n = [—n,n] d as defined in the statement of the proposition. 

We now want to find a sequence of reflections u\, . . . , such that Qn{ f{s)) ai '" <Tk = Q n for all s < t. 

First we show how to bring a non-centered interval to a centered one in Z. Let A = [a — n, a + n], 
where a G Z and n G N. Define the reflection a around the point a/2 via 

<r(x) = a — x. 

Then it is clear that a maps the interval [a — n,a + n] to the interval [— n, n]. If a > 0, define 
H+ = {k G Z : k < a/2} and H~ to be its complement. If a < 0, define H + = {k € Z : k > a/2}. 
It is then easy to see that A a = [—n,n] and [— n,n} (T = [—n,n]. 

Next we define reflections in Z rf . Let A = [oi — ni, ai + ni] x . . . x [a^ — rid, ad + n d] and for 
i = 1 , . . . , d let 

@i{x\ i ■ ■ ■ i Xd) — {x\ , . . . , Xi— i , Oj Xj , Xj_)_l , . . . , Xd) • 

Then A ai '" ad = [—nx,ni] x . . . x [— rid,nd] and if B is a centered rectangle, then B cl "' Cd = B. 
This way we see that there exist k < td reflections o\ , . . . , such that 

Qn(/(s)r- CT * = Qn for all s < t. 



Applying Lemma 3.5 k times concludes the proof of the proposition. 



□ 



4 Better to run than hide 



In this section we give the proof of Theorem 1.7 We first define a class of graphs indexed by n,m 



and denoted G n ^ m . For n = 2 and m = 12 the graph is illustrated in Figure [3j We then prove that 
£^2,12 is an example of a graph satisfying the statement of Theorem |1.7| for a lazy discrete time 
walk. We conclude the section by proving that Gj^o is such that it is best for a target to move in 
order to avoid collision with a continuous time walk. 

Definition 4.1. Let m be a multiple of 4 and G n ^ m a graph on n 2 m vertices divided into m 
clusters. We think of the clusters as the nodes of Z m and so we number them 0, . . . , m— 1. We 
give coordinates to each element of every cluster. The elements of cluster i have coordinates i(a,b), 
where a, b G Z n . We put an edge between 

(1) all pairs i(a, b),j(c, d) with \i — j\ = 1; 

(2) all pairs i(a, b),j(a, d) with b ^ d, i even and j = (i + m/4) mod m; 

(3) all pairs i(a, b),j(c, b) with a ^ c, i even and j = (i — m/4) mod m; 

(4) all pairs i(a, b),j(c, b) with a ^ c, i odd and j = (i + m/4) mod m; 

(5) all pairs i(a, b),j(a, d) with b ^ d, i odd and j = {% — m/4) mod m. 
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Figure 3: Graph £2,12 



We call the edges of type (1) "short" while the edges of type (2), (3), (4) and (5) "long". 

Remark 4.2. Intuitively, notice that for a fixed m as n goes to infinity, the long edges of G n ^ m are 
rarely used, and hence G n) m looks more like Z m . 

Claim 4.1. G n ^ m is a vertex transitive graph. 

Proof. Let i(a,b),j(c,d) be two vertices of the graph G n;m . In order to show that G n ^ m is vertex 
transitive, we need to construct an automorphism ip : V — > V that preserves edges and satisfies 
<p(i(a, b)) = j(c, d). We consider two separate cases, depending on whether j — i is even or odd. 
If j — i is even, then we set 

ip(k(u, v)) = {{k + j — i) mod m)((u + c — a) mod n, (v + d — b) mod n). 
If j — i is odd, then we set 

f(k(u, v)) = {{k + j — i) mod m)((v + c — b) mod n, (u + d — a) mod n). 

It is straightforward to check that ip is an automorphism that preserves edges. □ 

Lemma 4.3. Let X be a simple random walk on (^2,12 which is either discrete or continuous. Then 
we have 

maxE x [T y ] = E 0(0)0) [r 6(ljl) ] . (4.1) 

Proof. It suffices to prove the lemma for a discrete time random walk. Since ^2,12 is vertex 
transitive, it follows that for x £ V we have 

maxE^k] = maxE x [rJ . 
x,y y 
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(a) Short edges 



(b) Long edges 



Figure 4: Edges of (72,12 



So taking x = 0(0, 0), it suffices to show that for all a, b G Z2 we have 



E 0(0,0) [ T 6(a,f>)] 



maxE 0(0i0) [T y ] . 



(4.2) 



First we observe that starting from any point in cluster 0, the first time the random walk hits 
cluster 6, the position is uniform. Indeed, if we reach cluster 6 having used at least one short edge, 
then this is clear. If we use only long edges, then by the construction of the graph, with the first 
long edge we have randomized the column and with the second long edge we have randomized the 
row. Arguing similarly, if we start from cluster 0, the position at the first hitting time of cluster 
i 7^ 3, 9 is uniform. Hence, if Tj is the first time that we hit cluster i 7^ 3, 9, then 



where the last expectation means that we start from a uniform point in cluster i and wait to hit 
i(a,b). Since the graph is transitive, it follows that for all clusters i and all a,b 



We now define the process Y to be the number of the cluster we are at. More precisely, Yt = i if 
and only if Xt = i(a, b) for some a, b. It is easy to check that Y is a Markov chain even with respect 
to the enlarged filtration which at time t also contains the information about X up to time t. The 
process Y is a walk on Z12 with additional edges. From that it follows that for all a, b we have 



E 0(0,0) [ T i(a,b)] = E 0(0,0)Pi] + [ T i(a,b)] , 



E t/j [ T i(a,b)] 



= Z. 



(4.3) 



E oM [T i } = h(i)=E[0^i] 



and h(i) satisfies a system of 6 (by symmetry) linear equations, with solution given by 



fc(6) = 16, h(5) = h(7) = 16, h(4) = h(8) = 15, 

h(3) = h(9) = 13, h(2) = h(10) = 13, h(l) = h(ll) = 10. 



(4.4) 
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Putting everything together, we deduce that for all i 7^ 3, 9 

Eo(o,o) [n(a,b)] = E[0 -m] + E Vi [T i{a>b) ] = h(i) + z. (4.5) 



From (4.4), we obtain that 



Eo(o,o) [ r 6(i,i)] = E 0(0j0) [Tii a 6) ] (4.6) 
1^,3,9 



and it remains to show that 



E (o,o) [ r 6(l,l)] ^ ™ E 0(0>0) [T i{a ,b)] ■ (4.7) 

Let T be the first time that we hit cluster 3 without using the long edge — > 3 directly. It then 
follows that at time T the position in cluster 3 is uniform. Hence we have 

Eo(o,o) [n(a,b)) < HT] + E Us [r 3( „, 6) ] = E[T] + z. 



In view of (4.5) it thus suffices to show 

E[T] < E[0 6] = 16. (4.8) 

Let X be the first time that the walk is off the "shuttle" — > 3. Then X has the geometric 
distribution P(X = i) = qp l ~ l with p = 1/6 and q = 1 — p = 5/6. We can now write 

E[T] = 1+ ^ P(X = i)Ax+ HX = i)A 2 , 

i=l,3,... i=2,4,... 

where A± and ^2 are given by 

2 2 1 72 

Ai = -E[l 3] + -E[ll -> 3] + -E[9 3] = — 
5 5 5 5 

2 2 1 53 

A 2 = -E[4 3] + -E[2 3] + -E[6 ->• 3] = — . 
5 5 5 5 

Substituting we deduce 

104 

E[T] = ^ < 16, 

and hence this concludes the proof of the lemma. □ 



Proof of Theorem 1.7 (for lazy walk). From Lemma 4.3 we have that the pair that maximizes 



E^Ty] is x = 0(0,0) and y = 6(1,1). (Lemma 4.3 is stated for a non-lazy walk, but the hitting 



times of the non-lazy and lazy walk are equal up to a factor of 2.) We will now prove that if the 
moving target stays at position 5(1, 1) for 2 time steps and then moves to 6(1, 1), then the expected 
hitting time is larger than E (o,o)[6(l, 1)]- 

We write t^q for the time to hit the moving target. Then notice that — T e n t u is non-zero if 
we hit 6 at time 1 or 2. We thus have 

E 0(0,0) [ T 5-^6 - 76(1,1)] > ^0(0,0) ( r 6(l,l) < 2) > C> 

and this concludes the proof of the theorem for a lazy walk. □ 
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Proof of Theorem 1.7 (for continuous time walk). Consider the graph (77,20 • Solving the sys- 



tem of expected hitting times and arguing in exactly the same way as in the proof of Lemma 4.3 
we get that 

E (o,o) [ r io(i,i)] = maxE^Ty] . 

We now describe a strategy for the moving particle that achieves bigger expected hitting time. 
Suppose that f(t) = 8(1,1) when t < e and f(t) = 10(1,1) for t > e, where e > will be 
determined. 

Note that Tf — no(l,l) is nonzero if and only if Tio(i,i) < s or Tf < e. To simplify notation we write 
instead of 0(0,0) and no instead of t 10 (i,i). We now have 

Eq[t/ - no] = E [(r/ - tio)1(t/ < e or no < £)] 

= E [(r/ -no)l(n <e)]+Eo[(r/-rio)l(no <e,r/ > e)] . (4.9) 
We look at each of these two terms separately. For the first one we get 

E [(r/ - no)l(r/ < e)] > E [r/ - no | r/ < e,r/ < no]Eo(r/ < e,r/ < no) • (4.10) 

By the definition of Tf we have {rj < e} = {T g n n < e}. We now describe an equivalent way of 
viewing the continuous time chain. To every edge adjacent to a vertex x we assign an exponential 
clock of parameter l/d(x), where d{x) is the degree of x. Then the Markov chain crosses the edge of 
the first exponential clock that rings. In order to hit 8(1, 1) before time e at least four exponential 
clocks of a constant parameter should have rung. Thus 

P (t/ < e,no > Tf) < ce 4 . 

It is easy to see that there exists a constant d independent of e so that 

Eo[no - Tf I Tf < e, no > Tf] < c. 

Indeed, this expectation can be bounded from above by the commute time between 8(1, 1) and 10(1, 1) 
which is at most twice the distance between 8(1, 1) and 10(1, 1) times the total number of edges of 
GV,2o- Therefore plugging these estimates in (4.10) we obtain for a positive constant c\ 

E [(r/ - no)l(r/ < e)] > - Cl e\ (4.11) 



For the second term of (4.9) we have 

E [(r/ - no)l(rio < £,T f > e)] > E [(r/ - no)l(no < e/2,r/ > e)} > |P (no < e/2,r/ > e) 
and arguing as above we obtain 

P (no <e/2,r f >e) xe 2 . 

Putting all these estimates together we deduce 

E [t/ - no] > c 2 e 3 - cie 4 , 

which can be made strictly positive by choosing e > sufficiently small and this completes the 
proof of the theorem. 

□ 
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